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Oil  Lite  and  On-line  fatigue  truck  growth  prediction  of  Aluminum  2024  compact  -tension 
(CT)  specimens  under  vuriublc  loading  h as  been  modeled,  using  multivariate  Gaussian 
Pracess  technique.  The  Gaussian  Pnxwi  model  projects  the  input  spucc  to  an  output  spucc 
by  prohabihstKally  inferring  the  underlying  non-linear  function  relating  input  und  output. 
For  the  off-line  prediction  the  input  space  of  the  model  is  trained  with  puramrters  that  affect 
fatigue  crack  growth,  vuch  as  number  of  fatigue  cycles,  minimum  load,  maximum  loud,  and 
load  ratio.  For  the  case  of  online  prediction,  the  model  input  spucc  iv  trained  using  features 
found  from  piezoelectric  sensor  signals  rather  thun  training  the  input  space  with  loading 
parameters,  which  are  difficult  to  measure  in  u  real  tune  scenario.  Two  different  algorithms 
such  as  Principal  Component  Analysis  (PCA  I  and  Kernel  Principal  Component  Analysis 
(KPCA)  are  used  to  extract  the  principal  feuturcs  from  sensor  signals.  In  both  the  off-iine 
und  on-line  case  the  output  space  is  truined  with  known  associated  crack  lengths.  Once  the 
Gaussian  process  model  Is  trained,  a  new  output  space  for  which  the  corresponding  cruck 
length  or  dumage  state  is  not  known  »s  predicted  using  the  truined  Guussian  process  model. 
Concepts  arc  validated  through  several  numerical  examples. 
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Nomenclature 

•  i*  random  crack  length 

•  N*  I*'  tot  (unknown)  crawl  length 

-  d  x  if  covari^c  matrix  for  PCA  feature  extraction 

-  |  X  .  Cl  .  Gaussian  Process  training  spate 

-  Inpc*  diiwnsoon 

-  NuirAer  of  sensor  observation  used  tor  PCA  or  KPC A  at  any  fatigu:  cycle  instances 

•  Number  of  different  taugue  cycle  msurA.cs 

•  iV  x  »V  kernel  m.tnx  for  Gaussian  Process  input-output  jpoce  mapping 

•  J  x  if  kernel  matrix  for  Kernel  PCA  feature  extraction 

-  <1  x  1  i**  Fatigue  instances  input  vector 

•  d  x  l  N*!f‘  test  input  vector 

-  1  x  d  Sensor  observation 


1  Granule  Research  Associate.  McchanKal  A  Aerospace  Engineering,  suhhasish  mohant)  W xsuedi 
1  Professor.  Mcchx&xal  A  Aerospace  Engineering,  adiu4f  asuedu.  Fellow  A1AA. 

'  Associate  Professor.  Mcitunxal  A  Aerospace  Engineering,  pperalta4iasu.edu. 

*  Associate  Scientist.  Intelligent  Uider  standing.  sdas4iarc.na.xi.gov. 


Report  Documentation  l’aj;c 


»*4Ali*  A  »<i  «‘^lu  I  t*4J  p*f  M^4«.  4.1  l«  !••»  (■  <4 

uttnMi k«  Ik* »•*•. u  y  Iilpitm  far.v*^  fca  l*.HM**OfM*««. 

VA2iili-4Hl  lM«^  w  /...  U  ar  4ta  . . .  ..  f...~  U  -V*^i  a 

!•*  •<  kM  4  uii  UVH  .««4»4  M<*I 


<•»•«>.  121* 
,*l,I..U4.f 


ri*l*4  i*u  »A4.M  |4»<>e  4a 

l*u  it  i«*  .<Ut««t 

f}  *4|*-4«U*«  at<44B«f  4 


»  mu:  andsivtitu-- 

Off-Line  and  On* Line  Fatigue  (.'rack  <»ru\ith  Prediction  ('sing 

Mulln  arijlc  (iaussian  Procos 


r  rtiftKiKVUM;  t nee ^nl/amim  kamiisi  ami  .u:or.nvi:v 

Arizona  State  University  .Department  of  .Mechanical  &  .\eruvpace 
Knzinccrine.Tempe.AZ.K5  287 


i 


tmSMOJSU'MIXNmttIM;  'Y  NAV*jS;  AND  ADIttUXtitN 


II  Dl IB mus, A V AIAHU.II V  JCrAlfcWtNT 

Approved  for  public  release:  distribution  unlimited 


<  daiwc*o\  ».w.d 

00*00*2008  to  00*01*2008 


V*  CXKCfRACT  ?*1 


^  C*\.VI  MMHt:K 


V  ntIKiKAV!  IIJ.VO-.VT  Nil 


VJ  IIOIXTM! 


V  TASK  MNBI'H 


M  WOtK  UNIT  NlXIBtl 


<  ft'.MlSSLMINC  OIUSANI/ATUJN' 
III»t tXl  Nl  MlttK 


10  smWMIK'VXIVTCOK  S  ACKOSYVIiN 


II  VttXSVOKiVXINTTOKSKmMir 

mvimmosi 


i>  si  rmiMiroARY  sunn 

VIA  A  Journal.  2008.  submitted 


IS  SI  •811:1*1  I?RMS 


if.  siimrrY  claxiiikatwn  c* 


aklllAT  I  ft  AUTkV.I 

une  las: sifted 


1?  I.IVUTATKJN  U1 

IS  Nt  Vl«*  I 

.VAOKAH 

or  I'Aiitit  i 

Same  as 

23 

Report  (SAR) 

I.  Introduction 


^^ircraft  maintcnaiKc  must  haianje  l.hor.  logistic.  and  equipment  budget  constraints  with  the  competing 
requirements  ot'  fleet  readme**.  reliability.  xml  *ifety.  Recently  .  stringent  Diagnostic.  Prognostx.  and  Health 
Management  <PHM)  capability  require  eve  tits  are  being  placed  on  new  application*,  like  the  Jixnc  Strike  Fighter 
<JSF|{  1 1.  in  ccdcr  to  enable  and  reap  the  benefit*  of  kw  ard  revolutionary  Logistic  Support  concept*.  Though  the 
Prognost x*  ,«nl  Health  Management  <PHMi  (2|  it  the  name  given  to  the  capability  fcving  developed  by  JSF  to 
enable  the  vision  of  Autocomii  Logistic*  and  so  meet  the  overall  affordability  and  supporiahilrty  gaik.  similar 
PHM  system*  can  be  developed  and  implemented  for  resu&ul  life  prognostics  and  health  management  of  any  civil, 
mechanical  or  aerosp^e  structure.  Currently  aggressive  research  is  going  on  for  development  of  an  integrated  PHM 
system,  however  these  research  activities  xe  generally  in  an  ifKipoenc  stage  to  address  the  stringent  requirement  ot'  a 
truly  effective  PHM  system.  Current  aerospace  practice  follows  a  dinuge  tolerant  reliability  engineering  madel 
whereby  structural  component*  are  regularly  inspected  and  replaced.  The  replaecd  component*  arc  not  necessarily  at 
the  end  of  its  designed  strength  These  pra:tice*  unnecessarily  add  to  the  overhauling  expenditure  and  time.  The 
dmugetolcrant  reliability  engineering  designs  are  generally  bised  on  x  physic*  based  fracture  incctunx*  xpprcuch 
or  a  data  driven  stochastic  appro.*  h.  The  physics-based  damage  toieranee  approach  th.it  is  widely  practiced  (3-6) 
and  constantly  been  utpeoved  is  primarily  based  on  linear  fracture  mechanic  *  (LPEMk  as  far  »  fatigue  failure  is 
concerned.  Another  form  of  damage  toleraxxe  approach,  known  as  a  life  usage  model  |7jS|.  is  aL*>  widely  used  and 
is  based  on  gathering  statistical  information  about  how  long  a  component  endures  before  failure,  and  uses  these 
stacistK*.  collected  from  a  large  population  sample,  to  make  remaining  life  predictions  lor  mdivtduil  components. 
However,  these  predictions  are  not  based  on  measured  characteristic*  of  the  individual  components.  In  addition, 
fatigue  life  of  aircraft  structural  components  under  service  loading  condition  (9.10)  is  often  analyzed  and  predicted 
bused  on  crack  growth  rates  ottamed  from  constant -unpliuxle  fatigue  testing  data  .  In  contrast  to  the  fatigue  crack 
growth  due  to  constant  ai  rphtixle  loading,  crack  grouth  caused  by  variable  amplitude  loadings  is  characterized  by 
retardiuon  and  .Kceleration  effects  (111.  which  extend  cr  reduce  the  lifetime  of  structures.  Cwnrntly  there  are  meny 
physic  s-based  model*  |3-6.  12.  I3|  with  empirical  parameters  available  to  model  crack  growth  with  retardation  and 
acceleration  effects.  These  inxlelt  reasonably  capture  the  dynamics  of  the  fatigue  crack  growth  under  variable 
loading  m  a  deterministic  framework.  However,  these  models  <k*  not  cxplxitly  moslel  the  uncertainty  in  crack 


growth  th.il  arises  do?  to  matter  |9.ll)|  in  m»cro*  structural  properties  and  subsequent  uncertainty  propagation  due  to 
loading  sequersce  effects. 

As  of  today  nuny  research  works  varying  from  medical  application  ( 1 4 1  to  aerospace  application  1 15|  show  the 
effective  use  of  re  oral  network  for  diagnostic  and  prognostic  system*.  However  few  of  these  rwut.il  network  nxdeb 
are  hated  on  the  explicit  uncertainty  cpuntifKJixin  approach  like  the  Bayesian  uncertainty  modeling  approach.  It  it 
noted  that  Hay  e tun  methods  allow  1 16}  complex  neural  network  models  to  be  used  without  fear  of  the  “over  fitting* 
that  can  occur  with  traditional  neural  network  learning  methodt.  However  the  Bayesian  analysts  of  neural  networks 
it  difficult  1 17)  because  a  simple  peior  over  weighing  pirameters  of  the  network  requiret  a  couple \  prior  over 
uni:  dying  functions  .ind.  hence,  it  becomes  computationally  intractable  The  present  piper  discusses  the  use  of  the 
Gautsun  Process  cpprcuch  (17.  1S|  fee  a  progncwtic  system  that  explicitly  models  Bayesian  uncertainty  into  the 
predicate  inxfcl.  A  Gaussian  process  tGPi  ir*xk:l  it  a  simplification  of  Bayesian  araly  sis  of  neural  networks  by 
assuming  that  the  multivariate  random  variables  are  gaussian  random  tanahles  m  an  infinite  icocotable  or 
continuousi  index  set  The  Gaussian  process  model  projects  the  input  spice  to  an  o*put  spice  by  probabilistically 
inferring  the  underlying  non- line  cr  function  relating  input  and  output 

In  the  presem  paper  both  of  time  and  online  predictions  or'  fatigue  crack  growth  m  Conduct  Tension  tCTj 
sanples  stc  made  using  a  multi  variate  Gaussian  process  model.  For  off  line  prediction  the  input  space  of  the  made! 
it  trained  with  parameters  that  affect  fatigue  crack  growth  such  as.  number  of  fatigue  cycles,  minimum  load, 
maximum  load,  and  load  ratio.  In  turn,  the  oc*put  space  is  linked  to  the  corresponding  crack  lengths  or  crack  growth 
rates.  The  Gaussian  Process,  models  the  scatter  m  fatigue  crack  growth  that  arises  due  to  micro  structural  tariability. 
loading  uncertainty  and  variability  due  to  manufacturing  tolerance.  Once  the  Gaussun  process  is  trained  with  a 
known  irpjt -output  data  set.  it  can  predict  the  output  crack  length  or  its  rate  under  the  pirticular  leading  envelope. 
For  the  case  of  online  prediction,  the  model  input  spice  is  trained  using  features  found  from  piezoelectric  tensor 
signals  rather  then  training  the  input  space  with  loading  parameters,  whereat,  the  output  space  is  trained  with 
corresponding  crack  lengths.  The  sensor  lecture*  arc  found  using  either  Principal  Coaponenc  Analysis  l  PC  A 1 1 19. 
2u|  cc  Kernel  Principal  Component  Analysis  rKPCA)  (21 1. 


II.  Technical  Approach 


The  inflowing  sectica  outline*  a  general  approach  lor  a  hybrid  prognosis  irai;l  with  a  detail  description  on  off¬ 
line  data  dnven  predictive  nxxkl  ard  system  idet*ific ation  based  on-line  predictive  model. 


A.  Georrul  Overview  on  llvhrid  Prognoses  Model 


A  hybrid  prognosis  mo&l  based  on  both  physic*  and  data  driven  hived  technique*  i*  being  developed.  A 
>c hematic  of  it*:  hybrid  prognoses  trade  1  is  shown  in  Fig.  1.  The  overall  prognosis  iradel  will  have  three  different 
modules:  oil  line  physics  based  iraxfcL  off-line  dita  driven  protubilistic  irxiiel  and  system  identification  based  an 
cn-bne  predxuve  model.  -VII  the  three  sub  modules  will  he  finall)  integrated  together  to  develop  a  hvtnd  prognosis 
trade).  The  off-line  physics -based  predictive  trade)  will  be  based  on  a  noo-bnear  fracture  mechanics  based 
approach.  a  tie  re  as  the  off-line  data  driven  model  and  on-line  system  identification  mod.*)  will  be  based  on  a 
prohihtlisti;  Gaussian  process  approach,  The  oil-lire  data  cfrivvn  itxdel  will  explicitly  model  the  mxro  level 
ixcetuinty  that  arises  due  to  microstructure  variability,  loading  uncertainty.  eK,  and  compicirent  the  off-line 
physics  based  mod:l  for  any  unmodelcd  evocerom  influences.  The  physacs-hised  iradel  combined  with  data  driven 
protuhilistK  iixdel  will  be  used  for  off-line  prediction  of  residual  useful  life  of  a  structural  compccents  under  an 
anticipated  flight  envelope,  whereas  pie/cv:  let  trie  sensor  stgrul  based  onbne  predictive  model  will  estimate  the 
current  damage  state  in  real  time  and  male  this  information  available  to  off-line  module  to  reassess  the  resadual 
useful  life  of  the  component  based  on  tho?e  real  time  information  The  present  p.ipci  discuses  only  on  the  predictive 
capability  of  dita  dnvvn  based  off-line  and  co-line  predictive  model. 
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Fig.  I  A  conceptual  hybrid  prognostic  model  (Source  of  the  fighter  plane  image  In  figure  is  from 

http://www.jd.mill. 


B.  Gaussian  Process  Based  Offline  Predictive  Model 


The  goal  of  Gaussica  process  data  driven  prediction  uuxL*l  is  to  compere  the  distribution  of  damage  state  lor 
future  instance*  lor  *hich  the  damage  allotting  physical  paraircier*  are  kno*n.  F:c  example.  the  loading  p./ternv 
wamber  ol  flight  cycles  elapsed,  initial  damage  size.  environmental  condition,  grain  sixe  distributions  xe  the  typical 
dmxige  allotting  physical  parameters.  The  Gaussian  prove**  assumes  de  scatter  in  crack  growth  (as  schematically 
>±wwn  in  Fig.  2|  is  due  to  variation  in  th?se  parameters.  Due  to  the  scatter  in  crjfck  length  or  the  damage  state,  at  any 
instances  the  damage  slate  loUovts  a  distribution  rather  than  being  deterministic.  Gaussian  process  assumes  this 
mdividuil  distribution  as  Gaussian  distribution  with  different  mean  and  variance  and  cvaJuates  the  conditional 
distribution  of  future  damage  state  (Ntlu  test  damage  state  as  depicted  in  Fig.  2 j  as  ^ a  \p=[%  a\'  x  )•  1  c,# 
to  cconpute  the  probability  distribution  of  the  damage  state  an „  given  a  test  input  t  and  a  set  of  *Ar’  training 


Fig  2  Individual  distributions  at  various  instances  of  time  those  collectively  make  Guussiun  I^roces*. 


Founts  ft  _  |X  uy  .  Tfc:  q  is  to*  i*  random  variable  at  i,k  laiigue  cycle.  Let  us  define  our  damage  sate  data  sector 
j  to  be  a  Gaussian  process  *ith  a  kernel  m;*rix  ^  .  By  doing  this  uv  have  bypassed  1 17.  IH|  the  step  oaf 

expressing  individual  priors  on  the  reuse  arxl  the  modeling  lure  lion  by  combining  both  priors  into  the  kernel  matrix 
K .  •  No*  the  Gaussian  distribution  over  <ix+ 1 1 1?.  IH.  22}  can  be  untten  as 


III 


Where  Z  iv  an  appropriate  normalizing  constant  ar*J  the  mean  ar* J  variance  of  the  uw  distribution  are.  respectively, 
denned  as: 


ci(Vt,  =  k‘  .K 


=  A*-k*  .K> 


2i 


In  Eq.  (2)  3V  i>  the  (IxiV)  trailing  output  vectc*  that  iv  here  the  crack  length  Wtereas*  .  kv.,.  k,  ***  ^ 
curtitioned  components  of  I  *  instances  kerne)  matrix  ^  and  can  respectively  described  as 


=*«*.-•*->  :  K  =*'*-•* W  *  =*<*•*, ).,ux-.. 


it  i 


In  E q.  (Tj  A;  iv  the  assumed  kerrel  function.  There  are  ituny  povsihk*  choices  of  price  kernel  lurctsons.  From  a 
modeling  point  of  view,  the  objective  is  to  specify  a  prior  kernel  tbit  contains  our  assuu^tnxiv  abex*  the  vmxtirc  of 
the  process  being  modeled.  Fcrmally.  we  are  required  to  specify  a  function  that  will  generate  a  positive  definite 
kernel  irutnv  for  any  set  of  inputs.  A  non- stationary  multi-layer  perception  |2i)  kernel  function  iv  used  lor  the 
current  Gaussian  Process  model  and  is  given  bv: 
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The  paraneiers  0t_|  *  ^  are  adjusted  to  ituximixe  the  kig  livelihood  L.  given  by 

<S| 

These  hypeiparameters  are  initialised  to  reasceubtc  values  and  then,  the  conjugate  gradient  method  is  used  to 
search  lor  their  optimal  values.  Initially  tb:  kercel  function  given  in  Eq.  |4)  is  evaluated  using  tb:  assumed  initial 
hyperparanvtcrs  and  the  input  space  vector**  .  The  input  sjxicc  vecurs  *  is  a  d'  dimensional  vector  with 


individual  elements  of  the  vector  contains  the  valu:  of  the  different  fatigue  affecting  parameters  at  the  i*  instances. 
Whereas,  ’d’  is  the  number  of  fatigue  affecting  physxal  parameters  for  off-lice  predictive  rnxicl  and  dimension  of 
sense*  signal  feature  vector  for  on-line  predictive  model. 


C.  Gaussian  Process  Based  On- hoc  Predictive  Model 


In  the  List  secticn  oc  discussed  the  off- lire  prediction  with  .1  <xiusm.a  process  input  )pace  generated  from 
kuding  change  information  and  other  tatigre  pirasreters.  However.  in  real  tune  it  is  hardly  possible  to  measirc 
loading  or  compliance  c  hinge  information  in  a  ctxvoonrre  that  is  already  asscitfcled  11*0  full  scale  flight  hardware. 
This  is  tveaave  the  load  cell*  are  usually  large  and  heavy  and  in  a  multi  axial  kiting  environment  it  is  utfttssihle  to 
measure  the  loading  change  mtccnutxin.  Homewr.  we  can  mount  small  pie/oelectnc  sensors  in  the  lull  scale 
hardware  to  treasure  ecpaivalent  loading  and  associated  compliance  change  information  in  a  real  tune  situation. 
These  sensor  signals  can  he  oteamed  .it  regular  instances  and  after  required  processing  can  t*  led  to  the  Gaussian 
Process  irput  space  to  map  input  sfuce  to  c**put  space  crack  length  or  crack  growih  rate.  Once  the  training  input 
space  and  training  output  sfuce  focired  using  Eq.  <  1 1  to  Eq.  i5)  ue  con  find  the  new  predicted  mean  and  variance  tor 
a  new  lest  irpai  space.  A  general  architecture  for  on-line  prediction  mxkl  is  stown  in  FigJ.  He  figure  shows  the 


Fig.  J  General  urc  hitert  urc  lor  on-line  predictive  model 

multiple  sensor  signals  that  jre  collected  .it  different  instances  of  a  fetfigue  kuding  envelop.  These  signals  form  the 

signal  space  for  the  feature  extraction  algorithms,  such  a*  Principal  Component  Arulysis  |PCAj  cc  Kernel  Principal 
Comporent  Analysts  tKPCA).  Tk  fee*  urc  extraction  algorithm  statistically  drnotse*  the  ongin.il  sigml  .»rel 


generate*  ranked  feature  vector*  ordered  »x cording  to  n*  lnformctfion  content  Once  the  feature  vector  i*  fixed  it  can 
fed  to  the  Gaussian  Process  irput  space  to  map  the  original  sensor  signal  with  the  corresponding  track  length  or 
crack  growth  rate.  The  detail  of  the  feature  extraction  algorithm*  are  discussed  below. 


1.  Prtodpat  Camponem  An. rf»  sii  (PCA } 

Principal  component  analvvat  |19.  20)  is  an  orthogocul  basts  transformation  that  hi*  been  widely  used  for 
multivariate  data  analysis  and  dimensionality  reduction.  Iccuitively.  PCA  is  a  poxes*  that  ui:fiuf>e*  the  direction  of 
the  principal  compoceni*  where  the  vanince  of  change*  in  dynamics  is  raiximum  Assuming  'M*  different 
observation*  ard  each  observation  with  d  dimension*  (as  described  in  Fig,  i)each  input  scigml  *fuce  y  vector  is 
a  A/Xl  \ector.  It  is  noted  thn  each  sensor  observation  is  a  i  . j  vector  named  as  „  .  Then  the  centered  d  X  d 
covariance  matrix  of  th:  data  set  /y  a  \  p  -  1  2  ^ e  ** 


c,-<(y,-<r,))(y,-<y,>>,>  ,6> 

Th:n  the  covariance  matrix  i*  dugnnalued  to  obtain  the  principal  coofonectt  and  th:  diagnnaluation  can  be 
pertomed  by  solving  the  following  eigenvalue  problem: 


2v=Cjr 

Th:  coordimic*  in  th:  eigenvector  basis  are  called  principal  compocent *.  The  sue  of  an  eigenvalue  x 
corresponding  to  »a  eigenvector  tof  covariance  mctrix  ^  f  equals  the  amount  of  v  .nonce  in  the  direction  of  v. 
Funhermore.  the  direction  of  the  first  *n*  eigenvectors  corresponding  to  th:  largest  ‘n*  eigenvalues  covers  as  much 
variance  as  possible  by  *n’  orthogonal  direction*.  For  th:  present  on-line  prediction  problem  the  first  eigenvector  is 
considered  to  hr  th:  irost  pristine  quantity  with  maximum  buried  information  and  called  th:  princi(\il  feature  vector. 
This  d  X  1  feature  vector  corresponds  to  th:  i“  instance*  input  vector  *  of  the  Gaussun  process  inpc*  space. 


2.  Kernel  Principal  Campontiu  Analys is  \KPCA  > 

One  carrot  assert  that  the  linear  PCA  will  always  detect  all  structures  in  a  given  data  vet.  B)  the  use  of  suitable 
crcdincar  feature*,  ore  can  extract  more  infontuiKin.  Kernel  PCA  (KPCA|(2I)  is  well  suited  to  extract  non-linear 
stnxturcs  in  the  data  Kerte!  PCA  extends  the  above  memoned  PCA  cpvproich.  and  perform*  principal  condone r/. 


R'  I  p  ■  1.2.---  d } 


analysis  in  a  high  dimensional  spice.  For  the*  purpose  th:  original  d.ta  given  by 


first  mapped  into  a  high  diitvnsxinal  vf sace  f'  via  a  (usually  noolmcari  mapping  <I>  ard  then  a  licear  PCA  is 
pertomed  co  the  mapped  data  Then  the  e/  X  l/  covtfunce  matrix  of  the  new  mapped  d.ta  set  can  he  found  at 


K.  ,  -  (<!•<*.).  4*  ix.  l)  -  *lx..x,l 

There  are  many  form  of  kertwl  fixxtxin.  For  the  present  feature  extraction  problem  a  radial  b»is  function  <RBF) 
[  1*.  21)  hived  kernel  function  is  used.  uh*h  h as  the  following  form: 


x,  u  * 1 


I9| 


Where,  the  hyperparametcr  v7  iv  assumed  constant  Then  th:  kernel  nutn.\  iv  diagonalized  to  obtain  the  principal 
coti'pxwnt*  .ck!  the  diagonaliaatioocan  he  performed  by  solving  the  following  eigenvalue  problem 


4v-K»  (10) 

Where  ^  ard  V  ire  respectively  the  eigenvalue  and  eigenvector.  Also  in  a  similar  way  as  described  for  PCA 
based  feature  extraction  technique,  the  first  feature  vector  from  every  Kernel  PCA  an.il)  sis  can  he  used  to  feed  the 
Gaussian  graces*  input  space. 


111.  Numerical  Verification 


Numerical  studies  have  been  conducted  to  verify  the  cftecuvctess  of  the  developed  prediction  inxiel  by  usang 
experimental  dau  ohiained  from  fatigue  tests  conducted  in-housc.  The  details  of  the  experiment  aid  numencal 
studies  are  dascutsed  hekiw. 

A.  Fatigue  Test  Experiment 

The  faiigvx*  experiment*  were  per  leaved  using  an  Iifetron  15.1 1  serves- hydraulic  load  frame  opening  at  20  H/. 
Eighteen  Al  2024  T351  Compact  Tension  (CT)  samples.  ca;h  6Jl  mm  thick,  were  used.  These  specimens  were 
fabricated  according  to  ASTM  F.M7-95  with  an  average  width  of  25.55  nun  tlrom  the  center  of  the  ptn  hole  to  the 
edge  of  th:  specimen)  and  an  average  height  of  5l>.6  nun.  To  simulate  typical  tlighc  loading  coodiixins  a  variable 
load  spectmm  was  programmed  into  the  digital  controller  of  the  load  frame.  The  spectrum,  as  co&d  to  the  load-cell. 


is  shown  in  Fig.  4.  Howewc  Ax*  to  noise  and  compiling  effect*  the  load  thit  wis  xtuiUy  applied  to  vtnx*u«  was 
someutut  ditlcrecc  than  that  prograiiurcd  to  the  controller.  The  minimum  and  nuxtmum  kadt  applied  to  the 


Fig.  4  lx»*>dmn  spectrum  programmed  to  load  frame  controller 

stnxturc  were  treasured  through  th:  kid  cell  ind  ire  used  to  constnx't  the  Gaussian  pnxess  input  spice.  it  iwist  he 


noced  thn  lor  each  simple  the  frame  was  stopped  .e#J  th:  corresponding  lead  cell  oexputs  were  recorded  it  chosen 
instances  during  the  experiment.  Each  time  the  test  was  stepped  i  high  resolution  picture  o«'  the  cracked  simple  was 
tiken  using  a  digital  cairera  to  gererite  the  output  spice  crack  length  data  The  corresponding  measured  crack 
lengths  tor  ditfcref*  samples  are  deputed  m  Fig.  5.  It  is  coted  that  CT  simples  xc  named  freon  ct4  Ifia  to  ct4.Uu. 
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Fig,  5  Kxperimtntul  crack  length  data 


Tfc:  prefix  'cl'  symbolizes  corrpact  tension.  ihe  middle  number  shows  the  cumber  of  the  sample.  and  the  suffix  ‘a* 
indicates  th.il  the  initial  notch  is  nude  along  the  rolling  direction  of  the  alumioam  plate.  The  ahsctec  of  some 
wmbers,  such  as  ct422a  (Fig.  5)  imply  that  the  data  could  not  be  collected  tor  those  saix^des  due  to  premiturc 
failure  of  the  sfuciiren.  Out  of  a  total  of  IS  samples  for  which  the  faunae  crack  length  data  were  available,  tour 
sait^des:  ct4l7a.  ct419a  ct42  la  and  ct42la  were  instrumented  with  a  pieyoclectre  seavor  and  .n  actuator.  A  typical 
instrumented  sample  after  tie*  fatigue  test  is  shown  in  Fig.  6.  When  the  test  frame  was  stopped  the  piezoelectric 
actu.*ror  was  excited  with  a  turrow  band  berst  signal.  The  corresponding  senser  signal  was  collected  using  a 
N.mccul  Instrument  INI)  data  acquisition  system.  These  collected  sigruls  are  used  as  input  to  the  on  line  predictive 
mxlel.  wheh  will  he  discussed  in  detail  later.  The  CT  specimens  were  not  reitoved  from  the  test  frame  and  were 
kept  under  tensile  static  loading  condition  dunng  this  sensor  data  collection  process  to  simulate  realistic  co-hoard 
conditions.  At  each  stopping  instant.  ISO  sensor  observations  were  collected,  cot  or*  which  100  were  selected  bused 
<®  a  Fast  Fourier  Transform  <FFT)  filter.  These  100  observations  were  used  as  inputs  to  PCA  or  KPCA  algorithms 
for  feature  extraction  at  those  instances. 


Fig.  6  Instrumented  CT  specimen 
B.  (Uussaan  Process  Off-line  Prediction 

The  Gaussian  process  input  spices  are  constructed  using  the  leud  cell  readings  at  different  insure  cs  and  the 
fatigue  cycles  at  those  instances  The  individual  \  is  a  j*|  vector  wuh  elements  comprising  fatigue  cycles, 
minimum  load.  maximum!  load  urd  loud  ratio  The  individual  x  *0fm  d  X  N  irput  training  sjxicc  and  the 
corresponding  \xN  observed  crack  lengths  (from  high  resolution  images)  form  the  training  ouif**  sp.ee.  The 
dimension  of  th:  input  sp.ee  can  be  varied  to  any  cumber,  hut  fee  the  present  study  it  is  restricted  to  one  for  single 


variate  prediction*  and  lour  tor  multivariate  predictions.  Foe  i  new  test  instate  with  known  input  *  the 


corresponding  mean  ottfput  crxk  fcarth  is  predicted  living  Eq.  |2)  Before  using  the  data  lor  GP  prediction  the  input 
and  c*xput  spice  variable*  are  logarithmically  scaled.  In  addition  to  following  a  zero  mean  Gaussian  pcocos  as 
Ascribed  in  Eq.  (I).  the  o.*put  crick  lengths  are  scaled  1*  zero  mean  random  data.  Both  the  single  and  multivariate 
prcdicticci*  of  output  cnck  lengths  are  nude  lor  all  IX  CV  specimen  <ref.  Fig.  5  k  It  is  noted  that  while  selecting  a 


Mg.  7a  Single  var  Late  prediction  Fig.  7b  Multi  vurbte  p  red  111  son 

particular  sample  a*  a  test  specimen,  the  data  from  rest  of  th:  seventeen  xurples  are  used  tor  training  the  Gauwian 

process  model.  Figure*  ?A  and  7B  show  the  single  variate  and  multivari^e  GP  prediction*  of  crack  length, 
respectively.  (Oiupiring  Fig.  7A  *ind  5.  u  can  he  seen  that  even  though  the  single  varute  GP  with  time  I  number  of 
cycle*)  a*  only  one  input  vangle  is  able  to  predict  an  average  crack  growth  curve,  it  is  unable  to  track  the  transient 
jump  in  crack  growih  thit  arises  due  to  transient  over  load  cycles  tFig.  4).  The  only  exception  is  sample  ct4!9a 
where  a  good  prediction  is  observed  tret.  Fig.  7A).  However,  comparing  Fig.  7B  and  5  it  c;n  he  seen  that  the 
multivariate  GP  captures  those  transient  loading  effect*  for  most  of  the  samples.  To  further  improve  th:  GP  off-line 
prediction,  a  r .re -based  prediction  his  been  abo  pendrmed.  In  this  case.  ratter  than  predicting  directly  tte:  crack 
length,  the  crack  growth  rite  i*  predicted  first,  and  tten  it  is  integrated  using  tim:  as  the  only  input  variable,  ard  the 
corresponding  crack  length  is  estimated.  From  a  numeral  perspective,  it  is  better  to  predxt  a  derivative  than  to 
predict  an  integral  there,  the  cnck  length)  for  a  highly  ron-*mooth  futKtion.  Also  from  a  physxal  perspective, 
fatigue  crack  growth  is  normally  expressed  in  term*  of'  a  first  order  ranlinear  fjte  equation.  Therefnre.  although  the 
direct  crack  length  based  GP  mold  is  capable  of  capturing  the  noolineanty.  the  rate-based  prediction  allows 
capturing  first  order  cnek  growth  rate,  and  helps  capture  the  phy*ics  of  a  dynamic  *>*iem.  However,  it  must  he 


uftd  thil  to  perform  a  rate -hated  crack  growth  otiii'utxin.  the  cycle  by  cycle  rate  hat  to  be  integrated  for  the  most 
correct  crack  growth  curve  ctumation  In  the  preset*  cate,  where  expcriiwnial  data  were  available  only  ax  ditcrctc 
mstaocet.  the  prediction  of  crack  growth  rale  it  pattible  .*  only  ttote  instare  ct  for  wtoch  the  input  tp»x*e  >ari;fclrt 
are  available  from  experimental  ohtctvahon.  Nevathekti  to  minute  a  continoxit  crack  length  curve  in  the  cycle 
by  cycle  integr./.um  prcects  when  the  crock  growth  rate  it  not  available  at  a  funicular  cycle,  th*:  cr»ck  growth  rate 
for  a  prevxiut  cycle  it  jvvamed  for  the  current  cycle.  A  cougar  turn  of  GP  prediction  of  crack  growth  rate  and  the 
crack  growth  rate  observed  frem  experiments  can  be  teen  in  Figv  HA  and  SB.  The  figure*  show  thit  with  the 
exception  of  a  tbghtly  lower  rate  prediction  compared  to  the  eigen  ire  ntal  rate,  there  it  a  good  correlation  between 
predicted  and  ohtened 


Ns  of  cycle? 


Fig,  Sa  PredMlcd  rule  from  multivariate  GP  Fig.  HB  Kate  from  experimental  observation 
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Fit  9a  4'oDlintKitK  crack  length  from 
integration  of  GP  estimated  rule 


No.  of  Cycles  >  io4 

Fig.  9b  Discrete  <  ruck  lengths  <ul  ripen  mental 
stopping  instances)  captured  from  Fig. 9a 


r**e*  in  the  context  of  transient  oxertcuding.  The  slight  ur*S:r  prediction  ir*  rate,  compared  to  experimental 
values  i>  attributed  to  the  Lick  of  contimxms  experimental  d;*a.  which  led  to  tto  use  of  on  averaging  technique  tor 
rate  estimation  over  Lirge  nuirtors  of  cwk>  Figure  9A  stows  th:  ccrzinuoas  crack  length  cstinutcd  for  difterci* 
sanies  ard  Fig.  9B  shows  the  crack  lengths diverete  instances  Inhere  experimental  diLi  were  collected)  captured 
from  Fig.9A.  Cnirjxiring  Figs.  9B  .«rd  5.  it  is  found  that  the  prediction  accuracy  improves  over  direct  crack  length 
hised  prediction  as  stows*  in  Fig.  ?B. 

C.  (.auvsiun  Process  On  line  Prediction 

For  the  online  Gaussian  Procevc  prediction  the  input  vector  *  in  the  Eq.  <4)  is  fed  with  M?mor  sigcul  feature* 
found  using  eittor  Principal  Cou^oner*  Analysis  or  Kernel  Pnrcipal  C'ompccent  Analysis.  At  e»Kh  observation 
instant.  N  <ref.  Eq.  1*5).  the  p*?zoelectr>c  actuator  as  shown  in  Fig.  0  is  actuated  with  a  furrow  Kind  hurst  signal. 
Tto*  burst  signal  as  stout*  in  Fig.  10  Kis  a  central  frecpaency  of  155  KHz  and  a  sampling  frccjoesxy  of  2Msfoec.  For 
c*:h  octuitxm.  15<I  Mrnsor  observations  are  obtained  tor  pcuhihilistic  feature  extraction.  Out  of  the  150  sensor 
c&servatioto  only  1CKI  are  used  for  the  feature  extraction.  At  any  typical  fatigue  instances  the  representative  sensor 
signals  used  fee  fetzurc  extraction  are  depicted  u*  Fig.  II.  These  100  observations  are  selected  based  on  a  Fast 
Fourier  Transform  filter  that 


Fix.  Ill  Burst  signal  applied  through  P/I  actuator 

allows  selecting  a  particular  sensor  signal  with  a  central  frecfx*ncy  m  a  range  of  155±  50  KHz.  Tto*  selection  of  50 
KHz  upper  and  lower  limit  is  Kised  on  the  assuirpcmn  th;*  tto  maximum  frequency  variation  oc'  tto  cheers  ed  signal 
will  not  cross  these  limits  oxer  tto  fatigue  leuding  envelope.  This  ensures  tKit  signals  containing  only  low  freqtxncy 


noise  due  to  the  h)draulic  pump  of  the  fatigue  frame  or  high  frequency  iux*c  due  to  other  environmental  factor*  ire 
noc  selected  in  tta  feature  extraction  process.  Once  the  first  MX)  sensor  signals  of  1000  sample*  each,  ire  selected, 
those  swiul*  are  used  is  inpa:  in  the  feature  extraction  algceithin.  With  thi*  information  the  volne  of  *M'  ind'd'  m 
expression 
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Fig.  1 1  Representative  Sensor  Signal  for  Feature  Extraction 
becomes  M-tiXl  and  d-IOtXL  Ike  reason  for  selecting  100  similar  observations  for  featcrc 


extraction  is  to  statistically  select  thr  hest  feature*  from  the  original  sir  nil.  which  may  hive  tamed  env  ircemcntal 
ncuse.  Using  the  cfoove  mentioned  signals.  the  tovaxuncc  iruinx  lEq.  6)  for  PCA  and  ihe  kernel  matrix  <Eq.  M)  for 
KPCA  are  eviluited.  The  covariance  matrix  for  PCA  and  the  Kernel  mitn.\  lor  KPCA  at  a  typical  observation 


instance  are 


Ml 


Flit.  12a  Covuriuncc  at  a  tvpicul  fatigue  instance  Mg.  1 2b  Kernri  at  a  typical  fatigue  instance 

for  Principal  (  omponent  Aiulyiis  for  Kernel  Principal  C  omponent  Analyw 


>i»un  m  Fig*.  12a  and  1 2b.  respectively.  The  cox.iri.irxc  matrix  is  used  to  solve  the  etgenvaUa;  prcfclem  Ascribed 
in  Eq.f?)  foe  PCA  based  texture  extraction.  and  the  kernel  trutnx  is  used  to  solve  the  eigenvalue  problem  described 
in  Fj)d9|  for  KPCA  based  feature  extraction  From  the  eigenvaUa;  analysis  the  first  eigenvector  M  selected  as  the 
feature  vector.  It  must  be  noted  that  the  feature  extraction  is  done  at  ca:h  discrete  insane,  where  ti*  fatigue  frame 
was  stopped  to  collect  d;*a  Tteis  leads  to  *N*  <Eq  1-5)  number  of  feature  vectors,  each  of  length  d  -M»M).  The  firs* 
feature  vectors  at  t)pical  fatigue  instore  c  found  from  PCA  and  KPCA  ore  respective!)  shown  in  Fig.  1 3a  and  1 3b- 


C)nce  the  feature  vectors  are  obtained  for  different  instances,  the  Gaussian  process  iroat  .od  output  sp*:c  arc 


formed.  The  irput  training  space  of  st/c  J  v.y  ,v  formed  from  the  ’N’  feature  vectors.  TTw  corresponding  trairure 


process  training  input  and  output  spaces  arc  foritxd  the  prediction  of  an  unseen  output  state,  here  tbx  crack  length  or 
crack  growth  rate,  is  mule  usang  Eq.  2-5.  Unlike  the  log  waling  of  bfecvth  irput  and  output  spaces  used  for  tbx  off-line 
pcedichccv  fee  tbx  co-hne  prediction  tftx  irput  space  as  not  scaled,  bus  the  outpex  spate  is  sealed  uuh  zero  ixxan.  unit 
variance  scaling.  Ibis  type  of'  scaling  is  performed  to  ensure  th*>i  both  the  input  and  tbx  output  spice*  haw  similar 
variances,  though  not  necessaril)  the  same.  It  is  noted  the*  the  Gamsian  process  wxutLs  well  when  the  distribution  of 
tAfcrl)ing  variables  haw  similar  mean  cxri  variances.  The  results  for  direct  crack  length  predicted  using  PC’ A 
bused  feature  e.uractico  technique  is  shown  in  Fig.  14.  and  results  with  the  KPCA  based  feature  extraction  technique 
as  shown  in  Fig.  15.  The  figures  indxate  tbit  the  match  between  experiment  .md  prediction  as  nor  at  good  for  all  the 
fatigue  leuding  emetepes  as  seen  for  the  off- lux*  prediction,  but  ilx*re  as  tbx*  same  qualitative  trend  between 
experiment  ard  prediction,  panic  ulcciy  doing  the  transient  fatigvx*  loading  phase.  This  as  because  during  the 
transient  oscr  load  regime  larger  numbers  of  dita  points  are  available  (ref.  Fig  .5)  compared  to  the  lower  load 
regime.  IXmng  tbx  lower  load  regime  tbx  crack  growth  as  assumed  stable  and  hecce  fewer  data  points  are  collected 
over  this 

ct41 7a  c#19a 


Fig.  14  Ibirccl  crock  length  prediction  tiring  PCA  features 


Fig.  15  Direct  crack  length  prediction  using  KPCA  leuturrs 


rcginv.  In  addition,  the  crack  growth  rate  during  lower  loud  regime  is  jppcoxim.cc ly  one  xd  half  order  of 
imgrutude  leu  c  011*4x11  cd  to  the  average  crack  growth  rote  diving  the  transient  high  loud  regime.  For  example  for  the 
ct425a  single.  the  average  cra:k  growth  rae  during  the  kiw'er  kud  regno;  it  approximately  l.ikll  xlCf5  mm/cycles. 
ottere.it  th:  approximate  average  rale  dunnr  the  third  high  load  regime  l8?c$  to  KHe$  cycles)  it  1.4  xllX4 
mmfcycles.  This  pcttsibly  Icadt  to  a  Gaussian  Process  Mailing  mismatch  and  subsequent  eironeout  prediction  in  the 
lower  load  regime.  TTv  telling  issues  will  he  adekressed  during  our  future  work.  Crack  growth  ratet  arc  also 
predicted  using  the  Gaussian  Process  hated  on-line  predictive  model.  The  crack  growth  r^es  are  predated  using 
fcoth  PCA  and  KPC’A  hated  teat ure  extraction  techniques,  and  ire  shown  in  Fig.  16  and  1?.  respectively.  The  figures 


indicate  thit  unlike 
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tig.  16  Crock  growth  rule  prediction  using PCA  features 
ct41?a  ct419a 


Fig.  17  C  rock  growth  rule  prediction  using  KPCA  feature* 

the  ease  erf  direct  crock  growth  prediction,  in  the  crock  growth  rote  prediction  there  is  better  correlation  between 

experimental  and  predicted  rates.  Also  it  i*  found  that  both  the  feature  cAtractico  algorithms  produce  similar  results 
co  crack  growth  rate  prediction,  except  in  the  case  of  tlw  ct423a  specimen.  For  this  specimen,  tlw  GP  prediction  of 


the  rale  with  KPCA  bocri  feature  correlate*  better  with  experiment  compared  to  PCA  hosed  GP  prediction.  The 
KPCA  based  GP  prediction  could  po**ihly  b:  improved  further  by  using  a  non  stationary  kernel  te.g,  Eq.  4j  as 
opposed  to  tb:  sUDonary  kernel  I Kc|.M|  used  lor  the  present  feature  exti.xtxm  problem  utixh  will  b:  our  future 
work.  Once  the  cr»xk  growth  rate*  are  predicted  using  GP.  the  continuous  cr»xk  length  can  be  estimated  vu  cycle  by 
cycle  inccgrattctt  of  the  predxted  rates.  In  tb:  absence  of  r**e  information  at  any  panxular  cycle,  a  strategy  similar 
to  tbit  tor  tb:  off-line  predxtmn  is  employed  to  estimate  the  corresponding  cr*:k  length  However.  it  is  noted  th»« 
for  the  online  predxtxin  case,  while  estimating  tb:  crack  length  in  the  lower  load  regime  the  integration  algorithm  is 
modified  to  select  the  minimum  between  tb:  GP  predicted  rate  and  a  rate  of  value  I.IM1  xIO  ’  mm/cyvles.  This 
value  is  found  from  experimental  observations  in  the  lower  load  reginv  of  CT42$a  samples,  but  is  of  similar  value 
lor  other  samples.  The  purpose  of  using  this  valu:  in  the  integration  process  is  to  avoid  using  a  spxious  rate  as 
predicted  from  tb:  GP  particularly  in  a  lower  load  regime.  Tb:  continuous  crack  lengths  as  integrated  from  the 
predicted  rate  are  sbawn  Fig.  IX  and  19.  respectively,  for  PCA  and  KPCA  bused  prediction*  Figures  14.  15.  IX  and 
19  show  tbit  fee  brth  tb:  PCA  and  the  KPCA  based  feature  extraction  techmqw*.  the  rate-based  predxtxin  of  crack 
length  growth  has  better  cccrckcion  with  e.\penmef*s  compared  to  the  direct  GP  prediction  of  crack  growth 
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Fig.  I*  KtllmaMd  cni«k  kngth  urtng  PCA  fcjturo 
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ur«>.-i  >.irubk  k>.»)mg  condition. 


3.  Tb:  ca-line  architecture  developed  iv  uved  lo  evaluite  tb:  perfcruunce  of  PC  A  and  hived  tcjtcrc  extraction 
algorithms  It  iv  found  tbit  in  voroe  c*te%  the  PCA  h.iv;d  prediction  algorithm  givev  better  prcdxtionv. 
whcre.ee  in  otherv  tb:  KPCA  ha>ed  prediction  perform*  better.  The  convtszecxy  in  kernel  hived  .tlgonthm  lor 
better  predation  will  he  investigated  in  future  work. 

4.  7b:  on-line  prediction  algorithm*  ire  uved  to  validate  a  realistic  situation.  where  the  coupon: under 

investigation  is  in  integral  put  of  a  larger  structural  avvcinhly  tin  the  present  cave  the  fatigue  frame) 

5.  In  the  present  framework.  uving  the  Bayesian  hived  prcfcibcJivtx  approach  the  uncertainty  du:  to  loading.  arxl 

nucmvtiuctural  paraireterv  iv  explicitly  modeled  in  tb:  prediction  algorithm  In  the  future  the  off-line 
Gatesian  Process  iroiel  will  b:  cmnhtned  with  a  physics-bused  nuclei  to  further  improve  the  prediction 
accuracy  and  hnrixon. 
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